Image processing apparatus and image processing method

ABSTRACT

An image processing system includes a plurality of image processing sections for performing predetermined image processing on input image data and for outputting the processed image data. A header in which image processing information is described is added to the input image data in order to create packet data, and the created packet data is transferred sequentially to a plurality of image processing sections. A given image processing section inputs the transferred packet data, performs image processing on the image data in accordance with the image processing information described in the header, recreates packet data by adding a header in which the image processing information is rewritten to the image data after processing, and outputs the recreated packet data. Thus, even in a state in which the number of pieces of image data, the amount of the management information thereof, etc., are large, it is possible to easily manage image processing without imposing a large load on a CPU.

CROSS REFERENCE TO RELATED APPLICATION

This application is a division of application Ser. No. 09/833,719, filedon Apr. 13, 2001, the entire disclosure of which is incorporated hereinby reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an image processing method andapparatus having a plurality of image processing sections for performingpredetermined image processing on input image data and for outputtingthe image data.

2. Description of Related Art

Digital multifunction machines (multifunction peripherals, hereinafterreferred to as “MFPs”) combining the functions of a copier, a fax, aprinter, etc., are widely used. In the MFPs, input/output operations bya scanner section, a printer section, etc., the operation of a functionfor connecting to a network and a communication line, and the functionof image processing of image data, as well as operations in which thoseare combined, are controlled by a control section (CPU) for controllingthe entire system.

An MFP typically comprises an image processing section having severalimage processing (IP) functions for performing various image processing,such as, for example, resolution conversion, binarization, rotationprocessing, and color conversion, on input image data. For example, in acopier disclosed in Laid-Open Japanese Patent No. 4-1771, an imageprocessing section is disclosed in which each of these functions isrealized as an image processing circuit, and each circuit is connectedin series so as to perform pipeline processing on the image data. Thesystem controller (CPU) of this copier is capable of performing settingsfor image processing in each image processing circuit and performingdata transfer instructions thereto via a bus line, and thus is capableof performing desired image processing for each area of an image.

Meanwhile, in recent years, MFSPs have appeared in which concurrentmultifunction operation is made possible such that, in addition tosimply combining a plurality of device functions so as to operate insequence, for example, while a fax operation is being performed, acopying operation can be performed. By using, as an example, a casewhere a copying operation is performed while a fax transmissionoperation is being performed, a conventional concurrent multifunctionoperation is described. Here, it is assumed that an image processingsection of the MFP is constructed so as to perform pipeline processingby a plurality of image processing circuits, as described in theconventional art. It is also assumed that image data for the faxoperation and image data for the copying operation, input by a scannersection, are temporarily stored in a memory in page units.

First, the MFP starts image processing on image data for faxtransmission. The CPU performs image processing settings for faxtransmission in each image processing circuit within the imageprocessing section via a bus line, etc. Examples of settings includeimage processing information (resolution, binarization processingmethod, angle of rotation, paper size, etc.) in each image processingcircuit (circuit having resolution conversion function, binarizationfunction, rotation function, etc.). After setting these pieces of imageprocessing information, image data for fax transmission is transferredfrom the memory to the image processing section, and image processing isperformed in sequence for each area in the image data. Then, when imageprocessing for one page of the image data for fax transmission iscompleted, image processing is started on the image data for the copyingoperation. The CPU sets image processing information in the imageprocessing section in order to perform image processing. After thesetting, the image data is transferred to the image processing section,and in a similar manner, image processing for one page is performed.

In this manner, conventionally, device function operations of thescanner section, the printer section, and the fax function section areconcurrently performed in parallel. However, the image processingperformed by the image processing section is only processing for eachdevice function operation, which is switched in page units and isperformed. That is, a concurrent multifunction operation is notperformed in the image processing section, and as is conventionallydone, the memory is allocated in page units and the image data isprocessed in page units. Therefore, it cannot be said that the memory isused effectively, and it cannot be said that efficiency is satisfactoryfrom the viewpoint of performing image processing.

Accordingly, an image processing apparatus has been conceived in whichimage data in page units is divided in advance into areas having apredetermined size before image processing is performed, and processingis performed in units of the divided area image data. For example, sincean image processing section having a construction for performing theabove-described pipeline processing can perform image processing foreach desired area, image processing in units of the divided area imagedata can be easily performed. As a result of forming the imageprocessing section in this manner, it is possible to use the memory inunits of the area image data.

In addition, since image data for a plurality of device functionoperations is input in units of the area image data, image processingcan be performed in parallel. For example, inside the image processingsection, parallel processing can be performed such that while resolutionconversion is being performed on the image data related to the faxcommunication operation, a rotation operation is performed on the imagedata related to the copying operation.

However, since image data in page units is divided into a plurality ofarea image data, the number of pieces of image data to be processedbecomes enormous. Furthermore, image data for the object of a differentimage processing operation coexists inside the image processing section.Therefore, in a case where setting for status recognition and imageprocessing of the image processing section, and image data transfercontrol, using a bus line, etc., which is conventionally performed, areperformed, the amount of management information to be processed becomesenormous. As a result, a problem arises in that it is difficult for theCPU which controls the entire system to manage the image processingsection.

Furthermore, in a case in which the number of pages to be processed at atime is increased without being limited to performing a concurrentmultifunction operation, the number of pieces of area image data, theamount of management information, etc., become enormous. In a similarmanner, a problem arises in that it is difficult for the CPU whichcontrols the entire system to manage the image processing section.

SUMMARY OF THE INVENTION

The present invention has been made to solve the above-describedproblems. An object of the present invention is to provide an imageprocessing apparatus and an image processing method, which are capableof easily managing image processing without imposing a large load on theCPU even in a state in which the number of pieces of image data, theamount of the management information thereof, etc., are large.

To achieve the above-mentioned object, according to a first aspect, thepresent invention provides an image processing apparatus having aplurality of image processing means for performing image processing oninput image data and for outputting the image data, the image processingapparatus comprising: creation means for creating packet data by addinga header in which image processing information is described for theimage data; and transfer means for transferring the packet data betweenthe creation means and each image processing means, wherein theplurality of image processing means input the packet data from thetransfer means, perform image processing on the image data on the basisof the image processing information described in the header, createpacket data by adding a header in which the image processing informationis rewritten for the image data after processing, and output the packetdata to the transfer means.

Another object of the present invention is to provide an imageprocessing apparatus and an image processing method, which are capableof performing image processing for a plurality of device functionoperations in a parallel manner without imposing a large load on the CPUeven in a state in which a plurality of device function operations arebeing performed.

To achieve the above-mentioned object, according to a second aspect, thepresent invention provides an image processing apparatus which has aplurality of image processing means for performing predetermined imageprocessing on input image data and for outputting the image data andwhich is capable of performing a plurality of device function operationsin parallel using a connected external device, the image processingapparatus comprising: first creation means for adding a header in whichimage processing information corresponding to a first device functionoperation is described for image data used in the first device functionoperation in order to create first packet data; second creation meansfor adding a header in which image processing information correspondingto a second device function operation is described for image data usedin the second device function operation in order to create second packetdata; and transfer means for transferring the packet data among thefirst creation means, the second creation means, and each imageprocessing means, wherein the plurality of image processing meanscomprise first image processing means which inputs the first packet datafrom the transfer means, which performs image processing on image dataon the basis of the image processing information described in theheader, which creates packet data by adding a header in which the imageprocessing information is rewritten for the image data after processing,and which outputs the packet data to the transfer means, and secondimage processing means, while processing related to the first packetdata is being performed in the first image processing means, whichinputs the second packet data from the transfer means, which performsimage processing on image data on the basis of the image processinginformation described in the header, which creates packet data by addinga header in which the image processing information is rewritten to theimage data after processing, and which outputs the packet data to thetransfer means.

Yet another object of the present invention is to provide an imageprocessing apparatus and an image processing method, which are capableof making the input/output interface portions common with other imageprocessing apparatuses in a case in which packet data is used for imageprocessing since a requested process can be specified only by analyzingthe information at the beginning of the input data.

To achieve the above-mentioned object, according to a third aspect, thepresent invention provides an image processing apparatus which isconnected to a predetermined data bus and which is capable oftransferring packet data to and from an external device via the databus, the packet data being such that a header in which image processinginformation is described is added to image data, the image processingapparatus comprising: input means for inputting packet data in such amanner that the data is divided into a header and image data, to whichpacket data is added to the header in which identification informationof a device and processing content information corresponding to theidentification information are described in sequence from the beginningof the header in accordance with the sequence of a device which performsprocessing; header analysis means for analyzing processing contentinformation described at the beginning of the header input by the inputmeans; image processing means for performing image processing on imagedata input by the input means on the basis of the analysis result by theheader analysis means; header creation means for creating a new headersuch that the identification information of an external device whichnext performs image processing and processing content informationcorresponding to the identification information are located at thebeginning of the header; and output means for newly creating packet datafrom the image data processed by the image processing means and from theheader created by the header creation means and for outputting thepacket data.

The above and further objects, aspects and novel features of theinvention will become more fully apparent from the following detaileddescription when read in conjunction with the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating an MFP (Multifunction Peripheral)to which an image processing apparatus of the present invention can beapplied;

FIG. 2 is a block diagram illustrating the details of an imageprocessing section 104 shown in FIG. 1;

FIG. 3 illustrates the format of packet data in this embodiment.

FIG. 4 is a flowchart illustrating the procedure of creating packet data300 shown in FIG. 3;

FIG. 5 is a diagram illustrating a situation in which tiled image datais created for each area from a one-page document 500;

FIG. 6 is a block diagram illustrating the internal construction of therotation function section 205 of FIG. 2;

FIG. 7 is a flowchart illustrating the operation of the image processingsection 104 of FIG. 1;

FIG. 8 is a first illustration of a status change of a header of packetdata when processing is performed in accordance with the flowchart shownin FIG. 7;

FIG. 9 is a block diagram illustrating the internal construction of theresolution conversion function section 203 of FIG. 2;

FIG. 10 is a second illustration of a status change of a header ofpacket data when processing is performed in accordance with theflowchart shown in FIG. 7;

FIG. 11 is a third illustration of a status change of a header of packetdata when processing is performed in accordance with the flowchart shownin FIG. 7;

FIG. 12 is a fourth illustration of a status change of a header ofpacket data when processing is performed in accordance with theflowchart shown in FIG. 7;

FIG. 13 is a flowchart illustrating the operation when tiled image datais transmitted by fax;

FIG. 14 is an illustration of settings of a fax function;

FIG. 15 is a first illustration of packet data when processing isperformed in accordance with the flowchart shown in FIG. 13;

FIG. 16 is a second illustration of packet data when processing isperformed in accordance with the flowchart shown in FIG. 13; and

FIG. 17 is a third illustration of packet data when processing isperformed in accordance with the flowchart shown in FIG. 13.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

The embodiments of the present invention will now be described belowwith reference to the attached drawings.

A block diagram of an MFP (Multifunction Peripheral) to which an imageprocessing apparatus of the present invention can be applied is shown inFIG. 1. It is assumed that the MFP described in this embodiment combinesthe functions of a fax, a printer, and a copier, and processes colorimage data.

Referring to the block diagram shown in FIG. 1, the entire constructionof the MFP in this embodiment will be described first. A CPU 101controls the entirety of the functions of the MFP, including an imageinput/output device, such as a scanner section and a printer section, animage processing section, a communication function section, etc.Furthermore, the CPU 101 performs a process of creating packet data (tobe described later). A ROM 102 has stored therein operation programs ofthe MFP, etc. A RAM 103 is used as a work area for the MFP to operate,and tiled image data (to be described later) is stored therein. An imageprocessing section 104 comprises a plurality of IP (Image Processing)function sections for performing various image processing, such as colorspace conversion, resolution conversion, binarization, and rotation, onpacket data. An operation section 105 displays the status and settinginformation of the MFP to a user and transfers an operation command fromthe user to the CPU 101.

A scanner section 106 is an image reading device for reading an imageand generating image data. The scanner section 106 comprises a lens forcollecting light reflected from a document, a CCD (Charge CoupledDevice) sensor for inputting light and converting it into electricalsignals, an analog signal processing section, and an analog-to-digitalconversion circuit (not shown). The scanner section 106 outputs thegenerated image data to a scanner I/F (interface) section 107. Thescanner I/F section 107 performs various scanner image processing, suchas space filtering processing and input color space conversion, on theimage data input from the scanner section 106. Furthermore, the scannerI/F section 107 divides image data obtained in page units into aplurality of pieces of tiled image data and outputs it to the imageprocessing section 104.

A printer I/F section 108 performs printer image processing, such asimage area (object) processing, and smoothing, on the image data outputfrom the image processing section 104. It is also possible for theprinter I/F section 108 to combine a plurality of pieces of tiled imagedata with page image data and to output it to a printer section 109. Theprinter section 109 forms an image on a printing medium on the basis ofthe image data output from the printer I/F section 108. The printersection 109 is, for example, a printer device, such as a laser beamprinter or an LED (Light-Emitting Diode) printer. In the case of a laserbeam printer, the printer section 109 is formed of an exposure controlsection having a semiconductor laser, an image forming section, atransfer control section (not shown) for transfer paper, etc.Instructions of operation to the scanner section 106, the scanner I/Fsection 107, the printer I/F section 108, and the printer section 109are performed by the CPU 101 via the image processing section 104.

A fax function section 110 transmits or receives image data via acommunication line on the basis of the information set in the operationsection 105, and performs a predetermined facsimile process. A networksection 111 connects various devices, such as a PC (Personal Computer)and other MFPs, on a network via a LAN (Local Area Network), etc.

Next, the details of the image processing section 104 are described withreference to the block diagram shown in FIG. 2. A crossbar switch 201interconnects each IP function section inside the image processingsection 104, the scanner I/F section 107, and the printer I/F section108 so that free transfer of image data is realized. IP (imageprocessing) function sections 202 to 205 perform respectively differentimage processing on the image data. It is assumed that the imageprocessing section in this embodiment has four IP function sectionsdescribed below.

A color-space conversion function section 202 perform, on the inputimage data, color conversion such that an RGB color space is convertedinto a CMYK color space which is a second color space. A resolutionconversion function section 203 performs resolution conversion on theinput image data. In this embodiment, it is assumed that the resolutionof the image data read by the scanner section 106 is 600×600 dpi. Thisimage data is converted into that at a resolution of, for example,100×200 dpi according to the purpose. A binarization function section204 performs binarization on the input image data by an appropriatemethod selected from a simple binarization, an error diffusion method,etc., according to the type of image data, such as a character or aphotograph. A rotation function section 205 performs rotation of, forexample, 90°, 180°, or 270°, on the input image data. Although thisembodiment was described by these four IP function sections, the imageprocessing section may comprise other IP function sections.

Next, a description is given of packet data used in this embodiment, anda method for creating the packet data. FIG. 3 shows the format of thepacket data in this embodiment. Packet data 300 is composed of a header301 and tiled image data 302. Here, the “tiled image data” is image dataformed of a rectangular area having a predetermined number of pixels inthe horizontal and vertical directions. The tiled image data 302 isprestored in the RAM 103. In the header 301, image processinginformation, such as the processing sequence of the IP function sectionsin a case where image processing for the tiled image data 302 isperformed, and processing contents in the respective IP functionsections, are described.

Next, the procedure of creating the packet data 300 is briefly describedwith reference to the flowchart shown in FIG. 4 by taking, as anexample, a case in which image data in page units read by the scannersection 106 is stored in the RAM 103.

Initially, in the operation section 105, a user performs a setting foran image reading process (S401). After the setting, the user issues areading start command, the CPU 101 receiving this command causes thescanner section 106 to start reading a document (S402). The image datain page units created by the scanner section 106 is input to the scannerI/F section 107, and the scanner I/F section 107 divides the page imagedata in tile units in accordance with the instructions of the CPU 101 inorder to create the tiled image data (S403).

Here, a creation process of step S403 is described in detail. As shownin FIG. 5, a one-page document 500, input as raster image data from thescanner section 106, is divided into a plurality of rectangular areas(tiles). Each rectangular area has a size of 32 pixels vertically and 32pixels horizontally, and tiled image data is created for each area.Here, if it is assumed that a document of A4 size is read at aresolution of 600×600 dpi by the scanner section 106 and is divided by atile of 32×32 pixels, 34,320 pieces of tiled image data is created fromthe document of A4 size. Furthermore, in the creation of tiled images,the CPU 101 performs a setting for the scanner I/F section 107 accordingto the reading resolution and the convenience of image processing,making it possible to cause the tiled image to have a shape and a numberof pixels for which handling is easy.

The created tiled image data is input to the image processing section104 and is transferred to the RAM 103 via the crossbar switch 201. Then,each piece of the tiled image data, together with identificationinformation, etc., is temporarily stored in a predetermined location inthe RAM 103 (S404). At this time, a management table of the tiled imagedata may be created within the RAM 103, and the address at which themanagement table is stored, identification information, etc., may becollectively managed. The CPU 101 creates a header in accordance with acommand related to image processing, set by the operation section 105,or in accordance with information set by a device connected via thenetwork section 111 (S405). The CPU 101 reads the tiled image datacorresponding to each header from the RAM 103. Then, the CPU 101 addsthe header to the read tiled image data in order to create packet datato be sent to the image processing section 104, and the processing isterminated (S406).

Although in the foregoing, the creation of the packet data in a casewhere image data is input by the scanner section 106 was described, theimage data input destination is not limited thereto, and the image datamay be input from the network section 111, the fax function section 110,etc. In the MFP of this embodiment, the network section 111 and the faxfunction section 110 can input image data transferred from an externaldevice, etc., and can store the input image data in the RAM 103. In acase where this image data is to be stored as tiled image data in theRAM 103, the CPU 101 may perform a dividing process on the input imagedata, or the network section 111 and the fax function section 110 mayperform a dividing process when image data is input and transfer thecreated tiled image data to the RAM 103.

Furthermore, the MFP of this embodiment may comprise a storage device(not shown), such as a hard disk drive (HDD), and a disk controller (notshown) for controlling access to the HDD and transfer of image datathrough a connection between the HDD and the system bus of the MFP. Alsoin this case, similarly, the CPU 01 may perform a dividing process onthe image data transferred from the disk controller, or the diskcontroller may perform a dividing process on the image data and transferthe created tiled image data to the RAM 103. In a case where image datais input from an external device, a HDD, etc., in this manner, and thetiled image data is stored once in the RAM 103, for the packet datacreating process, processing of step S405 and subsequent steps isperformed.

Next, the internal construction of the IP function sections 202 to 205is described. The IP function sections in this embodiment have the sameinternal construction. Here, as an example, the internal construction ofthe rotation function section 205 is described with reference to theblock diagram shown in FIG. 6.

An input I/F (interface) section 601 is connected to the crossbar switch201, so that the input packet data is divided into a header and tiledimage data. The header is then sent to a header analysis section 602,and the tiled image data is sent to a rotation processing section 603.The header analysis section 602 extracts image processing informationfrom the header input from the input I/F section 601 and analyzes theinformation. The header analysis section 602 determines the informationat the beginning of the image processing information to be processingcontent of the rotation processing section 603, and sets the imageprocessing content in the rotation processing section 603. As will bedescribed later, that described as the image processing content in theheader is a mode number for identifying which operation mode of theoperation modes in which the rotation processing section 603 can performprocessing operations should be performed. In the rotation processingsection 603, the mode number corresponds to the angle of rotation. Then,the header analysis section 602 transfers the header part after analysisto a header creation section 604.

The rotation processing section 603 is an IP function section forperforming image processing on the image data received from the inputI/F section 601 in accordance with the image processing content set bythe header analysis section 602. The rotation processing section 603performs rotation conversion of 0°, 90°, 180°, or 270° on the image dataon the basis of, for example, the set processing content (mode), andsends the image data after conversion to a data selection section 605.

The header creation section 604 recreates the header of the packet datawhich is input to the next image processing section from the headerinput from the header analysis section 602. The header creation section604 sends the created header to the data selection section 605. The dataselection section 605 selectively outputs the header from the dataselection section 605 and the image data output from the rotationprocessing section 603. The image data output from the data selectionsection 605 is in the form of packet data. An output I/F section 606,which is connected to the crossbar switch 201, outputs the packet datato the crossbar switch 201.

For the internal construction of the color-space conversion functionsection 202, the resolution conversion function section 203, and thebinarization function section 204, the same description can be made byonly replacing the rotation processing section 603, which is an IPfunction section, with a color-space conversion function section, aresolution conversion function section, and a binarization functionsection.

Next, a description is given of the operation of the image processingsection 104 in a case where image processing is performed on image data,for example, in the sequence shown in the flowchart in FIG. 7 and by theprocessing content (mode) in this embodiment. Furthermore, the statuschange of the header of the packet data, caused by this operation, isdescribed with reference to FIGS. 8, 10, 11, and 12.

As shown in FIG. 7, it is assumed that an operation is performed forprocessing the image data prestored in the RAM 103 (S701) in thesequence of mode 2 (S702) of the resolution conversion function section203→mode 0 (S703) of the binarization function section 204→mode 1 (S704)of the rotation function section 205 and for rewriting into the RAM 103(S705).

First, before entering the operation in each IP function section, theCPU 101 creates packet data from the tiled image data prestored in theRAM 103. The details of a header 800 of the created packet data storedin the RAM 103 are shown in FIG. 8. In the header 800, for the imageprocessing operation shown in FIG. 7, a set of an ID indicating which IPfunction section should be used and the mode of the image processingindicating what kind of image processing operation should be performedby that IP function section is described in sequence from the beginningof the header. Although in this embodiment, only the ID and the mode areshown, other information, such as data length, may be added to theheader as necessary.

Therefore, when the operation shown in FIG. 7 is to be performed, in afirst header part 801, the ID (IP 203) of the resolution conversionfunction section 203, which is an IP function section, which firstperforms processing, and the mode (mode 2) of image processing performedby the resolution conversion function section 203 are described. In asecond header part 802, the ID (IP 204) of the binarization functionsection 204 which next performs processing, and the mode (mode 0) ofimage processing are described. In a third header part 803, the ID (IP205) of the rotation function section 205, and the mode (mode 1) aredescribed. In a fourth header part 804, the ID (RAM 103) indicating theRAM 103 so that the data is rewritten into the RAM 103, and information(NC) indicating “no information” are described.

The CPU 101 transfers the packet data, in which image processinginformation such as the sequence of image processing and imageprocessing content indicated by the operation mode are described in theheader in this manner, to the resolution conversion function section203, which is an IP function section which first performs imageprocessing, via the crossbar switch 201.

The internal construction of the resolution conversion function section203 is shown in the block diagram of FIG. 9. As is clear from thecomparison with the rotation function section 205 of FIG. 6, a differentcomponent for each IP function section is only a resolution conversionprocessing section 903 which performs image processing in practice.

In the resolution conversion function section 203 receiving the packetdata, an input I/F section 901 divides the packet data into a header andtiled image data, and transfers the header to a header analysis section902 and transfers the tiled image data to the resolution conversionprocessing section 903. The header analysis section 902 analyzes theheader in order to read the operation mode (mode 2) described in thefirst header part 801, and sets the operation mode to be performed bythe resolution conversion processing section 903 to “2”.

The resolution conversion processing section 903 performs imageprocessing of operation mode 2 on the tiled image data received from theinput I/F section 901. For example, if the resolution of the input tiledimage data is 600×600 dpi, and if the operation mode number “2”indicates resolution conversion into 100×400 dpi, conversion forreducing an image is performed.

A header creation section 904 deletes its own ID and the operation modefrom the received header information, and shifts the data within theheader information to the left so that the second header part 802 inwhich the information of the IP function section to be processed next isdescribed is located at the beginning of the header. The newly createdheader is shown in FIG. 10. The information for the binarizationfunction section at the next IP function section is a first header part1001, and “no information” (NC) is added to a fourth header part 1002.Then, a data selection section 905 selectively outputs the newlyrecreated header and the image data after image processing, therebycreating packet data, and the created packet data is sent to an outputI/F section 906, and the packet data is sent to the binarizationfunction section 204.

The internal construction of the header creation section 904 will now bedescribed in detail below with reference to the block diagram shown inFIG. 11.

Referring to FIG. 11, reference numeral 1100 denotes a bus for inputtingheader information from the header analysis section 902 to the headercreation section 904. Reference numeral 1101 denotes a first memory forstoring the data of a first header part within the input headerinformation. Similarly, reference numeral 1102 denotes a second memoryfor storing the data of a second header part. Reference numeral 1103denotes a third memory for storing the data of a third header part.Reference numeral 1104 denotes a fourth memory for storing the data of afourth header part.

Reference numeral 1105 denotes a bus for transferring the data stored inthe second memory 1102 to the first memory 1101. Similarly, referencenumeral 1106 denotes a bus for transferring the data stored in the thirdmemory 1103 to the second memory 1102. Reference numeral 1107 denotes abus for transferring the data stored in the fourth memory 1104 to thethird memory 1103.

Reference numeral 1108 denotes an NC creation section for creating “noinformation” (NC). Reference numeral 1109 denotes a header informationrecreation section for recreating header information from the datastored in the first memory 1101, the second memory 1102, and the thirdmemory 1103 and from the data created by the NC creation section 1108.

Reference numerals 1110, 1111, 1112, and 1113 denote buses fortransferring the data of the first memory 1101, the second memory 1102,the third memory 1103, and the NC creation section 1108 to the headerinformation recreation section 1109, respectively. Reference numeral1114 denotes a bus for outputting the header information from the headerinformation recreation section 1109 to a data selection section 905.

Reference numeral 1115 denotes a control section for controlling theentire header creation section 904. The control section 1115 controlsthe first to fourth memories, the NC creation section 1108, the headerinformation recreation section 1109, and the buses by using a signalline (not shown).

Next, a description is given of the header creation process by theheader creation section 904 with reference to the flowchart shown inFIG. 12. The creation process shown in the flowchart of FIG. 12 iscontrolled by the control section 1115.

Initially, header information which is input from the header analysissection 902 via the bus 1100 in each memory. Here, if it is assumed thatthe header information 800 shown in FIG. 8 is input, the first headerpart 801 is stored in the first memory 1101, the second header part 802is stored in the second memory 1102, the third header part 803 is storedin the third memory 1103, and the fourth header part 804 is stored inthe fourth memory 1104 (step S1201).

Next, the data of each header part, stored in each memory, istransferred to the memory in which the previous header part is stored,and is stored therein. That is, the second header part 802 of the secondmemory 1102 is stored in the first memory 1101, the third header part803 of the third memory 1103 is stored in the second memory 1102, andthe fourth header part 804 of the fourth memory 1104 is stored in thethird memory 1103 (step S1202).

Then, the header information recreation section 1109 recreates theheader information based on the data transferred from the first to thirdmemories and the NC data created by the NC creation section. The headerpart is formed in order from the start of the header: the datatransferred from the first memory 1101, the data transferred from thesecond memory 1102, and the data transferred from the third memory 1103.Then, NC data is appended to the end. As a result, header information1000 shown in FIG. 10 is created (step S1203).

As a result of transferring the header information 1000 created by theheader information recreation section 1109 time data selection section905, a series of header creation processes is terminated (step S11204).

In step S1202, the data of each memory is transferred to the memory inwhich the previous header part is stored. At this time, the first headerpart 801 stored in the first memory 1101 has not been transferredanywhere. That is, as a result of the second header part being stored inthe first memory 1101, the first header part 801 is deleted from theheader information.

In step S1203, the header information recreation section 1109 createsthe header information in order from the start of the header: the firstmemory 1101, the second memory 1102, the third memory 1103, and the NCcreation section 1110. Also, as described above, the data of each headerpart is transferred among the memories in step S1202. Therefore, in theheader information recreation section 1109, the header information isrecreated in the form of the header information 1000 in which eachheader part is shifted toward the start in comparison with the headerinformation 800.

The construction of this header creation section is not possessed onlyby the resolution conversion function section 203, and the IP functionsections 202 to 205 have in common.

After the packet data is output from the resolution conversion functionsection 203, the above-described operations are repeated by each IPfunction section. The binarization function section 204 performs imageprocessing in operation mode 0, and the header of the output databecomes as shown in FIG. 13. Furthermore, the rotation function section205 performs image processing in operation mode 1, and the headerinformation part becomes as shown in FIG. 14. Then, in the packet dataoutput finally from the rotation function section 205, since the ID of afirst header part 1201 is the RAM 103, the data is rewritten into theRAM 103, and the series of operations is terminated.

In this embodiment, the header of the packet data is subjected to imageprocessing in the IP function section, after which the first header partis deleted, and the header part shifts forward in sequence to theprevious header part. As a result of shifting in this manner, the headeranalysis section needs only to analyze only the information at thebeginning of the packet data. Therefore, common design of the IPfunction sections becomes possible for portions other than thecomponents of the rotation processing section 603 and the resolutionconversion processing section 903, which perform image processing on thetiled image data.

Next, a description is given of the operation of an MFP in a case wherea user issues an operation command to use one device function possessedby the MFP, and image processing related to the device function isperformed on the image data according to the operation command. Here, adescription is given by taking, as an example, a case in which thedocument image stored in the RAM 103 is transmitted by fax withreference to the flowchart shown in FIG. 15.

Initially, the user performs a setting for fax transmission in theoperation section 105 of the MFP (S1501). In a touch panel (not shown)provided in the operation section, identification information of thedocument stored in the RAM 103 is displayed. It is possible for the userto select the document to be transmitted from the displayedidentification information. Also, it is assumed that the document imageis prestored in the RAM 103 in a tiled state.

After the document to be transmitted is selected, the “resolution” andthe “type of document” when the document is to be transmitted areselected. The settings of the fax function in this embodiment are shownin FIG. 16. For the settings of “resolution”, there are three selectionmodes of “standard”, “fine”, and “superfine”, and their specificresolutions are 100×100 dpi, 100×200 dpi, and 100×400 dpi, respectively.Also, for the settings of the “type of document”, there are “character”and a “photograph”. For specific processing, simple binarization isperformed in the case of a “character”, and an error diffusion processis performed in the case of a “photograph”. The table shown in FIG. 16is prestored in the ROM 102.

Here, “fine” is selected for “resolution”, and “character” is selectedfor the “type of document”. After all the settings related to the faxtransmission are completed, the user issues a transmission command bydepressing a start button (not shown) (S1502).

When the CPU 101 receives the settings in the operation section 105 andthe transmission command, the CPU 101 reads corresponding setting valuesfrom the table shown in FIG. 16, which is prestored in the ROM 102.Then, the CPU 101 creates a header in which the identificationinformation and the image processing mode of the IP function sectionused for image processing are described in sequence. Furthermore, theCPU 101 reads the tiled image data corresponding to the document to betransmitted from the RAM 103 and adds the created header to the readtiled image data, thereby creating packet data (S1503).

The form of the created packet data is shown in FIG. 17. As shown inFIG. 16, the “fine mode” regarding the “resolution” corresponds to theprocess of mode 1 in the resolution conversion function section 203, andthe “character” regarding the “type of resolution” corresponds to theprocess of mode 0 in the binarization function section 204. Furthermore,in a case where fax transmission is performed, after image processing isperformed, since the data is stored once in the RAM 103, the processingsequence is resolution conversion function section 203→binarizationfunction section 204→RAM 103. The created packet data is input to thecrossbar switch 201, and the crossbar switch 201 transfers the packetdata to the resolution conversion function section 203 which is a firstIP function section.

The resolution conversion function section 203 inputs the transferredpacket data, and the input I/F section 901 divides the packet data to aheader and tiled image data, and transfers the header to the headeranalysis section 902 and transfers the tiled image data to theresolution conversion processing section 903. The header analysissection 902 analyzes the first header part of FIG. 17 at the beginningof the header, and issues instructions to the resolution conversionprocessing section 903 so that the process of mode 1 is performed. Theresolution conversion processing section 903 performs resolutionconversion in mode 1 corresponding to the “fine mode” (100×200 dpi) onthe input tiled image data (S1504). Based on the converted tiled imagedata, together with the header rewritten by the data selection section905, packet data shown in FIG. 18 is created, and the packet data istransmitted to the binarization function section 204, which is the nextIP function section, by the output I/F section 906.

Similarly, in the rotation function section 205, based on theinformation of the first header part at the beginning of the headershown in FIG. 18, a process of mode 0 corresponding to “character”(simple binarization) is performed, and new packet data shown in FIG. 19is created (S1505).

The created packet data is output from the image processing section 104via the crossbar switch 201 and is temporarily stored as tiled imagedata in the RAM 103 (S1506).

The tiled image data which is stored once in the RAM 103 is transferredin a fax transmittable document form to the fax section 110. The faxsection 110 performs encoding, such as MMR (Modified Modified Read), onthe transferred image data, and after the image data is modulated by amodem, it is transmitted to the other party via a communication line,and the series of processing is terminated (S1507).

Although in this embodiment, only the operations in fax transmissionwere described, even when, for example, operations, such as electronicsort, PDL (Page Description Language) print, and color copying, areperformed, image processing by packet data can be described by the sameconstruction and procedure.

Next, as an example of a concurrent multifunction operation in thisembodiment, a description is given of a case in which fax transmission,and a copying operation using electronic sort are performed in parallel.

Here, the electronic sort function is described briefly. In a case wherea plurality of copies of the document is made, the printer section ofthe MFP prevents mixing of copies by causing each copy to be assigned toa plurality of bins provided therein and by performing paper ejection,which is performed conventionally. In contrast, recently, a digitalcopier has been proposed in which sheets of paper are output by changingtheir direction of paper ejection for each copy with respect to one bin.This digital copier changes the direction of the image by performing arotation process on the input image data within the device, and theprinter section forms an image on the basis of the image data in whichthe direction of the image is changed, thereby changing the ejectiondirection of the output paper. In the MFP of this embodiment, the imageprocessing section 104 is provided with the rotation function section205. Therefore, in the MFP of the embodiment, while the CPU 101 controlsthe operation of the scanner section 106 and the printer section 109,image processing using the rotation function section 205 is performed,making it possible to perform this electronic sort function.

The flow of the image data in a case where electronic sort is performedby the MFP of this embodiment is described below. First, the reading ofthe document by the scanner section 106 is performed similarly to theoperation from steps S402 to S404 in the flowchart in FIG. 4, and thetiled image data is stored once in the RAM 103. Here, if the number ofdocuments is large and all the tiled image data cannot be stored in theRAM 103, the data may be stored in a HDD (not shown) as required.

The CPU 101 adds a header, in which processing information of 90°rotation and processing sequence information so as for the data to bereturned to the RAM 103 again are described, to the tiled image datawhich is stored once in the RAM 103 in order to create packet data. Thecreated packet data is then transferred to the image processing section104, and the packet data which is rotated by 90° by the rotationfunction section 205 is stored again as the tiled image data in the RAM103.

The CPU 101 transfers the tiled image data stored in the RAM 103 to theprinter I/F section 108, and the printer I/F section 108 reconstructsthe tiled image data into image data in page units. The created imagedata in page units is sent to the printer section 109, and the printersection 109 forms an image on output paper on the basis of thetransferred image data, and the output paper on which an image is formedis output to a paper-ejection tray. The above process is repeated untila specified number of copies of image output is completed. At this time,by changing the angle of rotation in units of copies, electronic sort isrealized.

In the foregoing, the operation in a case where electronic sort of theMFP according to this embodiment was described. It is assumed that,while a copying operation using this electronic sort function is beingperformed, the operator instructs a fax operation shown in FIG. 13.Then, the CPU 101 starts the fax operation according to theinstructions, and the MFP enters a state of a concurrent multifunctionoperation in which a fax operation and a copying operation using theelectronic sort function are performed concurrently. At this time, theimage processing section 104 is in a state in which the resolutionconversion function section 203 and the binarization function section204 are used for the fax operation, and the rotation function section205 is used for the copying operation (electronic sort). Therefore, inthe image processing section 104, image data to be processed in the faxoperation, and image data to be processed in the copying operationcoexist.

However, as has thus been described, even when a large number of imageprocessing is performed concurrently, the CPU 101 needs only to performa process for creating packet data and transferring the packet data tothe first IP function section, and does not need to perform statusmanagement related to each IP function and timing control related toimage data. Therefore, it is possible to perform a concurrent operationwithout imposing a large load on the CPU 101.

In addition, by performing processing in tile units, there is no need toprovide an image processing section for each operation and memory inpage units, and efficient image processing can be performed.

In this example, a concurrent multifunction operations of a fax functionand an electronic sort function were described. As a concurrentoperation, the same description can be made even for a case of a faxoperation and a PDL print, and a case of electronic sort and a PDLprint.

Furthermore, the concurrent multifunction operation is not limited totwo functions, and, for example, a concurrent multifunction operation ofthree functions, such as a fax operation, electronic sort, and a PDLprint, may be performed.

As has thus been described, according to this embodiment, a header inwhich image processing sequence information, processing contentinformation, etc., are described is added to tiled image data so as tocreate packet data, and the created packet data is transferred among IPfunction sections. Furthermore, within each IP function section, packetdata is input, and image processing of the tiled image data is performedin accordance with the processing content information described in theheader, and packet data to which the header, in which the imageprocessing sequence information and the processing content informationare rewritten, is added to the tiled image data after processing and isoutput.

As a result, advantages can be obtained in that the management of eachIP function section in a series of image processing operations performedby the CPU can be facilitated, and the load of the management of theimage processing section in the control of the entire system can bereduced.

According to this embodiment, when a copying operation using anelectronic sort function and a fax transmission operation are performedin parallel, packet data corresponding to the copying operation iscreated by using tiled image data for the copying operation, and packetdata corresponding to the fax operation is created by using tiled imagedata for the fax operation, so that the packet data for the copyingoperation and the packet data for the fax transmission operation coexistin the image processing section. Then, in the image processing section,while processing of the packet data for the copying operation is beingperformed by an IP function section, in another IP function section,processing of the packet data for the fax operation is performed.

As a result, even in a state in which a concurrent multifunctionoperation is performed, the CPU needs only to create packet datacorresponding to the respective operations, yielding the advantage thatimage processing can be performed efficiently without imposing a largeload on the CPU. Furthermore, since processing in units of tiled imagedata becomes possible, it is not necessary to allocate a memory and animage processing section in page units, yielding the advantage thatefficient image processing can be performed.

In addition, image processing information in the header of the packetdata in this embodiment is described in sequence from the beginning ofthe header in accordance with the sequence in which image processing isperformed. Then, in the IP function section, after image processing isperformed, a first header part is deleted, and the header part isshifted forward in sequence to the previous header part. As a result,the header analysis section in each IP section needs only to analyzeonly the information at the beginning of the packet data, yielding theadvantage that common design of the construction in each IP functionsection is made possible.

Many different embodiments of the present invention may be constructedwithout departing from the spirit and scope of the present invention. Itshould be understood that the present invention is not limited to thespecific embodiments described in this specification. To the contrary,the present invention is intended to cover various modifications andequivalent arrangements included within the spirit and scope of theinvention as hereafter claimed. The scope of the following claims is tobe accorded the broadest interpretation so as to encompass all suchmodifications, equivalent structures and functions.

1: An image processing apparatus comprising: a first image processingunit adapted to perform a first image process on image data; a secondimage processing unit adapted to perform a second image process on theimage data; a packet-data creation unit adapted to create a first packetdata by adding to the image data a first identification information foridentifying the first image processing unit; and a transfer unit adaptedto transfer the first packet data created by the packet-data creationunit to the first image processing unit based on the firstidentification information, wherein the first image processing unit isadapted to create a second packet data by adding to the image data, towhich the first image process is performed, a second identificationinformation for identifying the second image processing unit, andwherein the transfer unit transfers the second packet data created bythe first image processing unit to the second image processing unitbased on the second identification information. 2: An image processingapparatus according to claim 1, wherein the packet-data creation unitcreates the first packet data by adding to the image data the firstidentification information and the second identification information,and wherein the first image processing unit creates the second packetdata by adding to the image data, to which the first image process isperformed, the second identification information which is added to thefirst packet data. 3: An image processing apparatus according to claim2, wherein the first identification information and the secondidentification information are described in sequence from a beginning ofthe first Packet data so that the first image process is performedearlier than the second image process. 4: An image processing apparatusaccording to claim 1, further comprising: an input unit adapted to inputpage image data; and a generation unit adapted to generate a pluralityof image data by dividing the page image data into a predetermined size.5: An image processing apparatus according to claim 4, furthercomprising: a storage unit adapted to store the plurality of the imagedata generated by the generation unit, wherein the transfer unittransfers the image data, to which the first image process and thesecond image process are performed, to the storage unit. 6: An imageprocessing apparatus according to claim 5, further comprising: an imageforming unit adapted to form an image on a recording medium based on thepage image data, wherein the transfer unit transfer the page image data,which includes the plurality of the image data to which at least thefirst image process and the second image process are performed, from thestorage unit to the image forming unit. 7: An image processing apparatusaccording to claim 1, wherein one or both of the first image process andthe second image process is at least a image rotation process. 8: Animage processing apparatus according to claim 1, wherein one or both ofthe first image process and the second image process is at least a imageresolution conversion process. 9: An image processing apparatusaccording to claim 1, wherein the first image process is performed on afirst image data and the second image process is performed on a secondimage data, which is different form the first image data, and whereinthe first image process and the second image process may be performedsimultaneously. 10: An image processing apparatus according to claim 9,further comprising: an input unit adapted to input page image data; anda generation unit adapted to generate the first image data and thesecond image data by dividing the page image data into a predeterminedsize. 11: An image processing apparatus according to claim 1, furthercomprising: a first input unit adapted to input image data; and a secondinput unit adapted to input image data, wherein the first image processis performed on a first image data inputted by the first input unit andthe second image process is performed on a second image data inputted bythe second input unit, wherein the second image data is different fromthe first image data, and wherein the first image process and the secondimage process may be performed simultaneously. 12: An image processingapparatus according to claim 1, wherein the packet-data creation unitcreates the first packet data by adding to the image data a plurality ofidentification information corresponding to a number of image processingunits of the image processing apparatus. 13: An image processing methodfor performing image processing on image data, comprising the steps of:a first creation step of creating a first packet data by adding to theimage data a first identification information for identifying a firstimage processing unit, which performs a first image process on the imagedata; a first transfer step of transferring the first packet datacreated in the first creation step to the first image processing unitbased on the first identification information; a first image processingstep of performing the first image process on the image data included inthe first packet data; a second creation step of creating a secondpacket data by adding to the image data, to which the first imageprocess is performed, a second identification information foridentifying a second image processing unit, which performs a secondimage process on image data; and a second transfer step of transferringthe second packet data created in the second creation step to the secondimage processing unit based on the second identification information.